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(57) Abstract 

Related information are generated 
for storing by learning in accordance with 
estimated camera movement information 
data expressing the movement of a video 
camera which is detected from required 
image signals picked up by the video 
camera and camera movement information 
data expressing the movement of the video 
camera which is obtained by a sensor for 
detecting the physical movement of the 
video camera simultaneously with the 
pickup of the required image signals. The 
estimated camera movement information 
data corresponding to input image signals 
are detected from the input image signals 
and, in accordance with the detected 
estimated camera movement information 
data and the related information, predicted 
camera movement information 
corresponding to the input image signals 
are generated and shaking signals for 
shaking an object are generated in 
accordance with the predicted camera 
movement information. The above 
processes can generate shaking data 
simply and at a low cost in accordance 
with existing image resources. 
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^t5o 0 i ooi§^^ h;ua^s6 2 - 1 fctj^-cau 5s ( 1 

2) *mW-?2>M%H7 h)l<£ LT> K^p = 0±O 2 ooft^ 
©Tk^fiJc^Uc, , u- q #ji-tR£*i£o i&#^^7 h;i/JiiNgg6 2-2 
(CiJ^Tti. S (13) ©»J*£fr-5fc»K:, K^q = 0±<D2o 

SbS^* 2-3 fc^TfcJu S (14) ©SlifSff 

Up , u- P £, it&£p = 0 ±co 2 -^(DiXU^o^m^^^ Y)\s(D&M 
fftfrv* , v- q #MiR£*l£ 0 MZ^t h^SiRS 6 2 - 4 fcfcl^ 
^ (15) (Dmn*'if -5 it^p = 0 ±09 2o0ftl 

h;i/(D7K¥^^u q , U- q £. lfi*lq = 0±<D2-DCD 

* 7S 4 3 tc&i^T, ±g3Ufc5£ (12) (15) tzt5 
v*TfiJfl!£iiSu, +u-,, v P +v-p, up -u- P , v q -v- q , 
u, -u-„, v P -v - P &mW£ti& 0 
-r&fc>*u 2ral*S6 3 - 1 ft $ ^ h;uMiR3§6 2 - 1 a>e> 

* 6 5 - 1 £«#<*ftT^SJi6#uq fcj&D#U AP^Lfefit (u q 
+ u-,) 5^^^^6 5-ltTOt5 0 

IsVX? 6 5-1 (C^J^^nfe^— ^fct x £ ?>(z^^ U 66-1 
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»m^6 3-2«:, hjmiRM6 2-2frt> s mmoix 

*6 5-2fc«|&U *fc: x ft^OMS^^h^o 

SM^Vp W^nst, -nftus;**6 5-2fc:«»*ft 
t^Mv-„tJ0lU 4D»Lfc« (v„ +v- p ) £1^**6 
5-2fc#t|&U :0?^ lt ^^ {Zn ^ 1J66 

-2 *i, IBtt^tlSo 

«*S6 4-lfct % r*»*»6 2-3*6**0©f« 

*^up ^6^^6 5.3^^ 

^**u- P *«*u ^gltl ( Up -u-p) *i^** 6 

66_3(: ^> taM^ti^o mmiz, m ( V , - v -,> 

h^O*^u.,tus;7^ 6 5 - 4(3 

ft**U *©**Ufc« (u, -u- q ) *Uj;^65-4fctt 
6 6-4tft|&^ IBIt^n§ 0 m (Vp _ v 



.1 
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-f 5$ ( i 2 ) iz^-r^oiz, ^'j66-i iznmzn 
t\m>t-$ ( Uq +u- q ) & N ^^^m^m^mcDoib, ^e^-w 

z £^#v y ©flj (w* + (1/r) v y ) ICitffiJLT^So 8&|g 
©ttflfcL-C, (v, , v y , v, ) tt , ±CK«»J«d 

T'#£/$£*i N [5]ijS5IS& (w.x , Wy , w« ) {± N itCigJl^^^T- 

6 e- liztmznxuz?-* ( U 

, +u-,) fr*n-/t* (LPF) 6 7- 1 C «fc D 

pf) 6 8- i-e**rit»ftaai-rscfc-e, **#v, 
&*>\ (-1/ (2f) ) (Dttm^mt. fem-rz^mmizz 

^'J 6 6-2«caatS*iiT^*T f -^ (vp +v- P ) tt, 
5$ ( 1 3) tc^-r«t-5tz N m^w, i:^v« (Dm (w y - ( 1/ 
r) w z ) fc:Jt«UTt>S. ^f, ^ij 6 6-2tz|3**tiT 
H*^-***,, D-y^ 7 ^;^ (LPF) 6 7-2ti!)fi* 

rt#ft»ttlt-*c:fcT?, ^w y sfftmu 

* (HPF) 6 8-2lZ±*)m®®frZtolii?Z>Z.tT; ^v, 
fc4b\ 5$ ( 1 3) fc*5W-3Jt0!l£» (- 1/ (2 f ) ) fc^WM 

6 6-3fi:E**nT^5f-^ (u P - U - P ) , Xfi^ 
(v, -v-„) ^ A (14) lzfrs?£*>iz, ffift 
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«*»6 9-ltt s 6 6- 3 J: 0^-* (u P -u-p) fifjR 

*tfj*n*:t*, e i - 3 j: o«ii&*n*ft*^ 

£fcs U 6 6 - 3 fr£>^-£ ( Vq - V - q ) tfmfrliitftlTg 
tztt*. z.<Dt-*\±^ fV:^ffia^S6 1 -3 iD^^tiS 

|s]t£(z, f!J3l3§ 6 9 - 2 te, ^ V 6 6 - 4 J; D^-* (u, - 
u-„) #tt*m<*ftT£fcfcS N ^©ffi^iC (15) T?^r«t"5K: N 

*nfeffi*fjs^©SitfiE^q-esijfi[t-So t 5 -^ (vp -v 

&3b\ S (14) ( 1/r) fc* x 3*gfcJ; SMj* 

ni^sctjti^, ^ ( 1 5) CJJltS^ (1/2) *k ^ 

*5 o 

S^&^t^^CDl&Jg^-*^ 3*ft^T|qI©ioajS (x" , 
y" , z " ) £ N 3 ffi&ff^i: LfeHltero^^Jg (roll' , p 
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itch' , y a w' ) -eiBE^nT^S. iJD&JKx" , y" , z 
" tt, *n*nj0if»8 2-1, ^D^g§8 2-2, Xtttt*»8 1 

8 2- i teases tiafcfcfctc, 8 4 _ ltttl&sns , m 

£*l<5o DCM^S 5-1*4, ^t-j 8 4- lfc|3tt*ftfc 

anHt§8 2-2(4, A±>^nfe-fe>^ai^y" fc, l/5>**8 3 
- 2 C«ft£ftT^ u 1/^7^8 3- 2 £ffl£ 

TSdfc-^ -b>-b-m^7y" *«#u ^^U8 4-2(cm^Ls 
taft^^So DC/$#Bfc£it8 5-2f4, ^t'J84-2tJ:D 

musis it*, *>v<Dm±,z» »e>m*i<Diiam&B***\s. 

Mn$&8 2-3tz&t>-rz 0 mw^8 2 -3a, mmms kp?,© 

^^83-3l:ttlM5^^ (z» -g) ft*«.** % 

8 4-3fc{ft&U IBH^-y-So ^trjs 4 - 3 Cg3t6<*n 
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■b^fr&OtMS^-*©-*^ ajgjg (roll' , p i t c 

h' , yaw' ) ^n^n. *^m$m<D?-b<Dm 

# (roll' , pitch' , yaw' ) fcLTffl*3ftS 0 
*>^60M7-*roll' , pitch' , yaw' tf*X 

x' =2x" (1 6) 

y' =2y" (17) 
z' =2 (z» -g) (1 8) 

^-m^x" *«#u ^-i84-icai*u 83«**s. 
tz, mnms 2-2 tk>-xn 3 - 2^ ^m^x±>vmtiy 

882-3fcUs;;**83-3tt, M#3£8 U0AA*nfcI 
(z" -g) **#U 8 4-3t3tt|&U £tt3«e. 

7eFy7S6 3{343^Ttt^ Xr^/S6 3-eif?,nt«^ 

85-1-85-3 *tl*ti* ty84-l-84-3t 

> y ' , z ' £ utiii^tSo 
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y' , z ' , roll' , pitch' , yaw' ) fcj\ mm%m. 
E14(cMoT> ^f^7S4 C^JltS*^ ^i&£mtm#l3I#jj5| 

si; i -in* tvMsmcDtij&anzEfamw^ mmmm^^im2 

HI 1 607D-ft-F(:^tiT^5„ 

wx , w.v , w, ) t:tt N m&^<? h^tticDmrn, ^m^m^cD 

^tV7I/-A^i) fc*^7»gM©#<si (m/s, rad/ 
s) 4:OHI©**«»j±^i.a& 5o l^cD^^-^i&^M 

S v » . - v » „ i: * - * ffl ^ ^ jc J: 0 Sifil^f H- S i 

X' =WxO+Wx, V,,+W.x2 Vx2+ • • -+WxnVxn (19) 

m + 1 7 DflUsBStiT^-Si: # * ^ lb 
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x 

X 



1 V x 1 1 V x 1 2 
1 V x 2 1 V x 2 2 



1 Vxmi Vxm2 



V x 1 n 
Vx2n 



inn ^ 



WxO 
Wx 1 



^ Wx n J 



(2 0) 



Whfztt. m&l&fry ' , z' , roll' , pitch' , ya 
w' lz-D\,^XbmWi~?:$>Z>o 

^ (20) (D&mtJix ^wjgmf&ftx* <Dmm&m>b£te& 
ct^t3, m>h-mmiz£*} urn i ^©^w^-wx.^af, 

mffi(D^£tfs fife©** vl&^S^fig^y ' , z ' , roll' , 
pitch' , yaw' fco^T i>fffr>tl%> 0 

Ell 8(i, 2 <DMf&m%mVT\,^Zo i&t^ 

^ MUtUgSgl 0 Ki, A^Siifciitfe (PH£tt^m3(c#t*& 
<*n£li^) fr*>I&£^ h;i/£$fcffiu I&^'hatS^g 10 2 
££^Kj£#£5gSItl?iB 10 3 fcm^UTV^o 
ill 0 2 lis A;b£ftfcl&#^ h;K3*-^VNTx A^iH^^KJ 
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7i&##t ;£gftJ?=gg 10 3lt h;Hf^^B l o 1 

DAtJ^ti, h;i/^itj^4'^stgf^S 1 0 2<t OG^;* 

io3ii, 03 iz&^xwiwvtzmz^? bjvmnnm 2 1 , m% 
*>bmnmw.2 2Rut/^^m^m^.mmmmm.2 3 ^leim©^ 
t mm * m -r £ & co t- & s 0 

7i&#^^iJSst^^@ 10 4lt h^i&js^-^k^^^^ 
stH£Sg 1 0 3 J: Dii&^ns*^ 5W)gffi7£m.£<DM.B 1 

mm 1 0 5tcm^f So im^-^atn^g 1 0 5&> A^tifc 

ia 1 9 ©7 d-^— h mi s^-rim^ 
m%^z h^nmmm 1 0 nz&iom^^z h jvmnmm-^n t>n, 

^r^rs 8 2izis^x, Ki^^hff-liLigK 1 0 2 tK Sbt© 

zmfemnmmm 1 0 3 j: 13, ^nwjgm femmm&m&n t> 

tl&o W±OXr-y7S 8 1 y 7S8 3 CDMUfciU 0 4 0)X 
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^m^^mm^wmm 1 0411 ^^^i&^jt^Mits 
^ii 0 3<t ^mzmfemt, mmmm^-tm 

ttJHf§l 2 2fcW;t7-rsj|i»&l 2 1 2 UOAA* 

-r&t>*>, 3U¥& 1 2 1 tt N -ft* ^m%mfemmm.w. 1 0 3 «t 
ct o^i&^nsHifeibfii^-^M^Rfcsjiifltbs ao»si 2 2 

tm*t5. flnf?£§ 12 2l±, 1 2 1 «fc fcA^Sftfe^-* 

(c, «3ct;:i/$;** 1 2 3 (cft^^tiT^fcT 1 — ^saoif 

1 2 3CMU IStm#2^5£tT",.|ii|ftil 2U0i 
So U^** 1 2 3 J: Om^iJfftfc^— *fcJU ^ ; E'J12 4(;-I 



31 



&%.&f)K 2 007 U — 2±m(Dmffl i £:fcH>T. Vxi., v»u, • 

X' i =WxO + W»lVxil+W»!VxiI + ' • ' + W x n V x i n 

(2 1) 

O L L ' , PITCH' , YAW &mW£tlZ><> 

5t^r^7"S8 5 izMtSo 
Xry7S8 5m I&JS^-^It^^g 1 0 5 £ <fc ?K 

kj i* ^ «u s e> ib s 7 s - * * it n *- s m s 35 s h *t £ n a 0 

^<D^^»y^S 8 6-Cft, i&Jg^-^tf^^M 1 0 5 tc 
J; *K ±71/— At;:-O^T*^>y:7°S84 RVXt v 7S 8 5 <Z)#l 
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Cut, i&Ji^— * to^tiBit &„ 
m 5 a, ^-©im^— ^cs-^t^j?;? 6 £®i&-f £gdt-&3*^ 
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m 1 : Hffi 






9 




















pitch 




pitch 




x" 


roll 




roll 




x' yaw' 


yaw 








yaw' 


X 




X 






y 




y 






z 




z 







z -e^^^tiSo 

• yaw' -ClS^ns, # — 7m<D^~gM *) tt> lt?Jg£&#yaw 
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i&Jgf## y a w iz Mm t5» 

ISi^pit ch, roll, yaw, x, y, z cd n 
tiM 1 t-^-f ^I/jJM^-p itchr , rollr , yaw r , x 
r , yr , zp ttx ^ft-^ftJ^TOJ: o CcltSf £ft5o 

HiSIS^P itchr fciu 

pitchr =LPF ( 2 P I T C H ' ) (22) 
-r&fc>*>s ^f&t^$JfiP I T C H' ©I^ZPITCH' 
?>fi»LPF (ZP ITCH' ) &M&Z$miz «fc *M#£,ft5 0 

Hfc> Hi&ISsJc^r olL tt s 

rollr =LPF ( 2 R 0 L L ' ) (23) 
-fftfr^ ^ib^^^iJSR 0 L L ' Ol^ZROLL' fre>{£ 
M^LPF ( 2 R O L L ' ) Satlltc «fc ft <bft3 0 

x , = H P F ( 2 X ' ) (24) 
"ffcfo^, ^ib^^ifJMX' <D|g#2X' :!(>^»HPF 
(2X' ) &3fcto£St3¥fc: <fc D»e»n5, 
Sfc, ^iiiS^^yr fcfc. 

y r =HP F ( 2 Y' ) (25) 
£p< ^I&#^«iJSY' cd^^2Y' ^^.ilWHPF 
(2Y' ) £*#>3atH£cfc Dff ?>tiSo 

Zr=HPF(2Z') (26) 

-r&t>t>s ^kj^^jsz ' ©«i^2 z * >e>ss**fi8^HP f 

(2Z' ) £**m-rs;ii:£J: ft So 

££ N ^ 1 fc^s Ufcft#ifrlffifft#p i t c h 3 , rolls , y 
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ttwmmf&ftp i t c hs 

pitchs = LPF (AX ' ) (27) 

(ax ' ) £*g>5atnic <t oft e,nso 

roll s =LPF (X' ) LPF (YAW ) (28) 
vifi^^ffliJSX' ©{giM^LPF (X' ) 
vl^filYAW com&f&fr L P F (YAW ) 

itwmmmfry aw a at* 

yaws =LPF (YAW ) (29) 
"Tftto^ *^7i6§^iiYAW' CD{£1M#LPF (YAW 



pitch = pitchr+pitchs (30) 

roll = rollr+roll s (31) 

yaw=yaw a (32) 

X = Xr (33) 

y = y r (34) 

z = z r (35) 



mmw*,, pitch' t± s mnmi 3 
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- 1 lz£ t)*S#£*i> .X^'J 134—1 tZHBtB^ftSo ^ ^ 'J 13 

(lpf) i3 5-naoiHi^ti5o T&fc>-^ ;rnt;:«fc»K 

^ (2 2) ©SU?£fTl^ %nm$Lftv i t c hr §W5o d 
©ct o \z. bT£fifc£ftfcfSttlSfiS#p itchr li, tinn%& 13 6 

*Di¥Sl 3 6lZlZ£tz. ^ (2 7) fc^L-fcf^i&Jg^-* p i 
t c hs #tt#&£*iTVN£o "f 133li, iit^M 

g^mmvo -tDCDftiftx' i/^7^i3 2-2i:s^$nt 

^5iB£«J*U ^OMS^t'J 1 3 4- 2CMI, IBtSi** 
n—^x 7 >< )l># (LPF) 13 5-211 ^^'J 134-2 

tchs J: Lt, *0»i§ 13 6 (ciii^-r-So 

^JP^^136ii, v—/*X7 j (LPF) 135-2£0{& 
l&^tifeftiiJS^pit chs £o — ^*:7>f;i/* (LPF) 
135-U Dt&^tifclli&Jg^-^sSG^p itchr ^flal??- 
Sdhlcj; 0. 5$ (30) (DmW&fi\,K *ffl»»«*ftp i t c 
h i: UTttJ^J-r^o 

^KlS^M©^^ ^ROLL' fcfc % flOHfs 1 3 1-2 
tl/^X^ 1 3 2 -3 lc<fc ^t'H34 - 3lz&&£ 

ft^ lBfl£ft3o n— (LPF) 1 3 5-3it ^^B 
V 1 3 4 - 3 iZtm$ntz7->!?CDi&i&mfr*ttiliiL, Aa#& 1 3 
8t3tfj^7-rSo fEcto^, dtiCtDs 5£ (2 3) ©«j|A«fft)n 

o 

iP»^ 1 3 8twttSfc, S (28) t?^-r«#«lSfi6^r oil 
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s A } i$&^nt^5o -r&fc>*>. d-/U7<j^ (lpf) 13 
5 -4(i N £&#x' (omMftzmttibs mnmi 3 i tzm^uT 

V^o £fz. D-^X?^ 1 3 5 - 5H\ ^YAW <DfM 
(£#&HlfflU jgj?& 1 3 7CtB^ttl>S 0 1 3 7 fct, P 

-/-?^7>f 1 3 5 -4©m*fcs o — M*7-f;u* (LPF) 
1 3 5 - 5<D/±J^^^^-r§c: tt\ i$ ( 2 8 ) £^-r«#£f?V^ 
*0%?|&&&jtni£gg l-3 8Caj^LT^5o *nJ¥« 13 8it 
d-/-?* 7 (LPF) 1 3 5 - 3(Dth±>tmW%s 1 3 7©m 

x&mn-r it (3 i) ©sm^m^ *©»imssi 

D-;t*7 -f (LPF) 13 5-6 fcfc, -h* vm^^mm.cD 

mfrYAW ©istajgR^samf sci £ 0 (29) t^-tsr 

J**fr^ JfoajMSSfca; (3 2) ICtotyawiiLtlllijt 

So 

^mB^mmoy^ ^#x' Aaais 1 3 1 - 3 hvv 

X* 1 3 2 - 4 13 £ ^'J13 4 - 4 tc£t#S£n, IB 

<t£ft£ 0 ^ )V5> (HPF) 135-7 tt. /^'J 13 

4 -4f3f3^£n;k^-*fre>KM#£ttmt-£C£fC < fc D> 5$ 

(24) ©ansfrVK ^(Dmnmzktt (3 3) c^otx^t 
3 2 — 5 £ j; ot^^n, 134-5 f3^t^^n N saltan 

So ^*7-f (HPF) 13 5- 81^ 134-5 
f3tt £ ftfc ^— *©&*$]$#& Mb m -fa d t(c«t (25) 
©»»©aS»&frV^ *©85lf«SS*S (3 4) «otyhlt 
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7^132 - 6(3<fc tJt^^n, /^'J 134-6 izmtfcgti, SB 
tt^nSo ;\4 4 JV9 (HPF) 1 3 5 - 9 (i N ^t'J13 

4 - 6 legate ^nfe^-^ojestSfig^sftiaj-rsi fc-e. a (2 

6) ©»J¥Sfrt^ (3 5) c^otztutiH 

i o 5©«iftk:oiN-csiwrso 7t^7s i i i (z^v^Th nib 

JSfiE^p itchr , rollr , x r , y r , z r #at^£ti£o 
-f&fr*^ ^a&#^iRijg<£>? % N ^PITCH' #iD»gl 
3 1-UI/^^13 2-1 CctOM^tl, 134-1 
£gati£ftSo 1 3 4 - 1 fcffltt^nfcT 1 — *fcl\ n-/^ 

(lpf) i 3 5 - ictD, zoii&mf&fr&ttimzn, 
fig^p itchr t i^xmn^ i 3 6 izi&mznzo 

33*^M&¥mm.R OLL' fe± % JD#S 13 1-2 h W>*** 1 
3 2 - 3 lz«fc Di^^^ ^ If 1 3 4 - 3 tzgSta^FttSo d— ^ 
* 7 -f (LPF) 13 5- 311 134-3 fcS3t6£ft 

fc^ — *©«JSfS#&»imU f£#r oil, tit, flp#»i 3 

8 iztts^-rso 

XA^mg^mmcDm.frx' n ia^gf i3i-3tu^^^i 

3 2 - 4 tefc !5fS^^n> /^'J 13 4 - 4 (ZHBtt^nSo 

(HPF) 13 5-711 ^t'J13 4 - 4l3gatl£ft 

^tt&^iJfiOS /Sfl-Y' fcj\ *P^^ 131-4i:l/^ 
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1 3 2 - 5 £ «fc bmfrZti, ^f'J 134-5 CSBtSSnSo 
M*;? (HP F ) 1 3 5 - 8 «\ ^t'J 134 - 5(CH3 

^m%^mm.<Do e£#z ' & N *nn#§ 13 l-stuj; 
1 3 2 - 6 t«fc sa#£*u u 1 34-6 icsBts^n^o 

-f (HP F) 135-99;, 134 - 6 .fcffi 

&tc, ^ryrSl 12 tc^^Ts f^#ftS^p itch s , 
rolls , yaws &MiW$ti2>a 

-f &fr*>s mnm i 3 3it m&<»ji *?m%^mm.(Do 

#X' U^^^ 1 3 2 - 2 «t 5 ««&$nsj® ACDJsK^S^i? 

Us ^t'J 134-2 fcttteU iata£-fc!-£o d — /i*:7>r 
(LPF) 13 5- 2I±, ^ t U 13 4-2 (3g3H££;tT/T £>:r — 
*©{KtSJ*#£tt§»JSJs£#p itchs h UT> 1 3 6 (c 

n-/^7^;i/^ (LPF) 1 3 5- 4lt ^m^^m\M(D 
o*>. je£#X' U n— (LPF) 

135-5H:, ft* ^W]^^m\m(Do *>> fiE^YAW CD&mf&fr 

zmtti-rzo mn^ 1 3 7 d-^u7^ ( l p f) 135 

- 4(Dm^jtn — ^^y 4 )\,# (LPF) 1 3 5 - 5 GDtfJ^ 
U J$#r oils £^j3oL-s fitiW-^t 138 -5° 

p-/^7-<;i/^ (lpf) i 3 5 - 6 li, ti t^mz^mmcD 

o*>s ^YAW 1 ft Aim U J$#.yaw s i:t5o 

£ 7ryrS 1 1 3££^Ts ^r«^S 1 1 ltll^? 



WO 00/68886 



PCT/JPOO/03039 



40 

X7JJ\,$ (LPF) 1 3 5 - 1 £ ^VklfeZn&nm&T-ZWLfr 
pitchr n—^X74Jl* (LPF) 1 3 5 - 2 <fc t> 
^nStt§iWr-^pit chs tZMWV. Mt&7 — *<D 
fig^p itchi: UttH^tSo 
JtIP^^13 8(is d— n^y<{)\,$ (LPF) 135-3«tD^ 

^^n^nmmm^r o 1 1 r mnm 1 3 7 & Qm&ztizix 

il»r-^roll s fc^flnUb, a&Jg^-^OEJc^r o 1 
1 £ UtliJiJtSo 
P-/^7-r;b^ (LPF) 13 5- 6(1 itBLfefitftM 
^ y a w s ^ ^©S^l&fS^ — *<D/?£#y a LTtii;*7 
-f£o A^;U7^;i/^ (LPF) 13 5- 7-13 5-911 £ 

x, y , z £: ITtB^fS. 

m$titzmi0L*x? > 4 fc^<*«5 0 fgMj#P£SB 5 

#J£EI2 310^0 2 AIZtts^o El 2 3 11 Jffijft 6 ©(H!liSH"T?& !K 

^j£6fl 7^fal-^ilbt6*0^7 h>14 1-1~1 



WO 00/68886 PCT/JP00/03039 

41 

4 1-6 Si^tt't), otlf,Ot^h>14 1-1—14 1-6 
ta0M14 2 fcftTl^So ^S14 2 tt±, 14 3 

#@^£nT*5»K 3CD^^F 1 4 3C7)±(3H§ 1 4 4#&5 «fc-3 £ 
&£ftT^£o K7h>141-1^14 1-6 (is ^tl^tup'to 

-1-14 1- 6^ f&*&7*-*£fifcg|E 2 (cj; ft 

£J;:J;-?T> 1 4 2 U $ <~> C6i 1 4 2 lzmfe£ fix 

usehp i 4 3 wmm-fZo 

03iKI2I2 5K:^-r«t"5tc % ;U2 1 1 fcJgiH£ftfc C P U(Centr 
al Processing Unit) 2 1 2 N ^t'J 2 1 3, At) 4 — m — 
X 2 1 4, jx—F >^-7i-^2 1 5 ^flj#-f >*-7 * 
2 1 6 J&ift: J: Oflldc^ns— JJftW*3>t:i— ^S/^^A 210 

flBSt^*;*^ CD-ROM&£©««ga»Ji#<0fl&s 



WO 00/68886 



PCT/JPOO/03039 



42 



WO 00/68886 



PCT/JPOO/03039 



43 

ns±fat7 r ^-*p< ^(Drnzzmrti* ^m^m^mnts ±33 1 
§ stfta -r 5 -t > -9- iz <t o t £ n fc±3B tr * * v (DVnmm 

2. ±hb*^< ^Mz^mmmiz&^^T, -x-jv^z v^mm-r 
z n &xDmmm^ sttiBM-5£j?J5^©£ £ <b \,zmx z> d a 

3. ±IBit/MM-^(3^-i>^T±HB^-^^ai^ h -SSgffij^ 

5 . ±!3ffitt^Si:^J«L-C±gBA^j0ilffe<g-^*^^-r*^^^ 
£ lif/ft* S ci i: &ftffi. £ * Sail #<7)$Effilg 4 %3Btt<Z)ti$?R4!L 



WO 00/68886 



PCT/JPOO/03039 



44 

g|3 h €> £: £ -T £ it IS 111 6 JSI3«0« MLS£t 

Bo 

mw<> 

9. ±ibs?i^^^ h^^m^Piis ±s3A2jiHftM-5© : F«>&3£«* 

11. ±33 VCft&m*>V&ffi*. 

1 JlgB«fi©ti^S^Ho 



WO 00/68886 



PCT/JPOO/03039 



45 

13. ±hb#p< ^m% j Fmmm£.m^&\3., ±nat>*^mgm%. 

«5Hfg 1 JI§3i$©tif MS^go 

15. ±IB*/^»&*«l^t»«lftm*S:t±, ±i3A*>IIHil«-if 

)hzm~3^x, m& zmg ±S3i&#^ 
it! -r s t> * m b Jt£tit«tftffl s a t & <mm. t -r a 

16. ±f3»»t4 j ^^mgi5«x aif&oiBjRttfitz^.^Ts ^-n^ 
is m % u co m ft is m tc * -3 v a t ± 13 s& § ff ^ * & 5£ r £ m s # <t> & 

tzttmtT &m#.(Difcmm 1 6jsib«o^s 



WO 00/68886 



PCT/JPOO/03039 



46 

fi o 

is. ±sei&t^ h;i/tftmgBttx ±mAjjmm.m^(n^ttomfe 

19. ±tB*>V£isXtia&m*>y-&ffi*.&z. + & 

2i. ±ga** ^mgmfemm®tm^m±. mmmmcD 
i sm&wta&w&Wo 

lb £ £ t£ ffi f 5 -b > -9- J: -d X % f# £ ft ± 13 K t * ti * ^ (D M m 

-oxm{%mm*£.m-rz>x7 L v rt, 

$?ffi£ftfc#* ^IftgJltJfctif*^ ±fBH0MS«i:fc:S-3^T* 



WO 00/68886 



PCT/JPOO/03039 



47 

* t>izm-?2>z. ii*<ftm.£T zm$.<Dffimm 2 3 mmm<Dm 
25. ±m*7is^? h zmm-TzzT- v r-r-&> ±m^y^x. 

27. ±aa*^7a*«i^t»ai*tfttfi-rs^7 i yr(4H ±iba^ 
±tBi&£*<i>i:i;:«-3v^ ±ib#* ^rngMfemmztfiiti-t 3* 

2 8. ±!3i6#4 I ^ : &^m-r2>^^iyrT"tt> }£2&<£> Unfile 

* a>^#*£i£ tc »^ ^ t ±isi& ^ 4j ^ £ -r s d £ & & r s 

2 9. ±H3I&#'^^&^t±i-r-S^^y ±IB1&£^ 
©7k¥fifc# h Sigfifc^ £ £ gij 4? (c mft f 3 £ £ ft a i: f S SI 5fc£> 
IbBS? 2 8^g3«OtS*«ia*ffio 

3 0. ±S3»§^^ N;i/*tftttJ"rs^5rs;7;TfH: N ±H3A^H^ 

tfetu-r s c: t *nwi£ -r &&&<Dt/&mm 2 1 imzmcDm mmmxteo 



WO 00/68886 



PCT/JPOO/03039 



48 

31. ±mmmmm&&i&-r2>x : ry rtii, ±$^>vt^x 

^TSsS^ofSISffi 2 2JlIB«c^m^5n ! 5i^^o 
5S&©jas#a»e>&3** ^ij^Jf^tf ^^^j^-r^c: t£#$c£:1-S 
3 4. ±12* p< ^i&^^l|ijm$g^^J^-r 5^ry ±HB# 

±33 1^** ^\z&&±.mmm(Dm&m^o>mm.iLmmz, m 

3 6. ±g3#* ^i&^m^tS^^^m-r^X^^r^, ±g3A^7 



WO 00/68886 



PCT/JP00/03039 



49 

Jbffift # f'k £ I^S<5 V^"C _LfE# > ^ ®j £ #t£tf $B Srtfctti-*- -5 * ^ 
yT'SrttS - £ SI 3fc0>*fiBB SB 3 5 JSf2^o^W^& 0 

37. ±aa»# tp'b&mm-tzx'r m$k<DMmfcwiz 

3 8. ±ae»# ^^^^w-f-^^T 1 yT'-cji, ±feib#-<^ h/u 

4 0. Jil2^i^^^5r^^-r?>^-r ^^T'lis -ttS-tr>ifi: LT 

4 1. -hia^l^^^^^fife-rsx^ 5/^T'{i, _tf2ir>-^ <t LT 
ftifia-fe^lMc J: 9 Bl n _b 32 f -7 s 7 <£>4fcJi&«>/«j:»j# & 



WO 00/68886 



50 



PCT/JP00/03039 



4 3. \z<f*u* "7^x^xmm^titzmm.(Dmmt^^h^m 
sns -lie^t**-*.* 7cd®j# ym^m^m nt . ±ie 

4 4. ilE^p ^7 -Mi, _h!E# p< 7»#^iB0fflf |Ri:S^i>T, 

r <t ^#m<t-r5ft*^ti5ia^4 3 JKiEite^^o ^9 a 35 

4 5. -hfE^cz ^7 -M±, ilElljffim^-l'S^V^TJilE^^v 5 ^ 

4 7. ±tE^n^7A(i, ±fE^-^^3i^ h &mmt mm lt± 



WO 00/68886 



51 



PCT/JPOO/03039 



-hBEDbt^ h/ui: JtSESb luS^^t, _kfE;>7 > 7 «J # 

4 9. ±SB»#f 3 .fr«:Sim*? l 5>7 p -cw\ ^Sl&oililSf fig 1^*31 ^ 
*tf>tQfflSg4 8 ^ISttO^n i/^ AfB»«E«s e 

5 1. -tffiA*JPHfef3 lb tb*^* h/i'SrtfeliltS^fy^-C 

5 2. ±iBM«ra$R*:£j*-*-.5*^5'7'-ei:J\ -hfEir Vb" i: IT 
ftUfr&ir ^tia 9 El^£nfc± SB try* 9<Z>«&3£8jftt&# £ 

5 3. ± ffi 08 « tiHS 5 _blBir^-^iLT 



WO 00/68886 



52 



PCT/JPOO/03039 



5 4. _tl2# * ^Eb^Jtt^timSrJfcfcH-t-S.XT 1 y ^x-fi, ^gcS 
5 7. ±g2*M 9tb#«l^-|*«S:tfej±j-r-5^^ y^tt, ±|2A^ 



WO 00/68886 



PCT/JPOO/03039 



53 

t»*^t5H^5 7mmmv>zfu ?7j±mm&&o 

tftW-t"5ri:4r^ai:i-5i»*0|6H!B5 6 £ IB 4ft cot" p ^ 7 A IE 

6 1. ±BE^J&^$c£r^fi5c-r5;*.-7 i y^ll, ±fE-tr ^ £ LX 
flPig&-fc>'iH£«fc 19 n ± HE t'T* 7©ftIW<Cft#i 

6 2. ±IS3E^«fS[«:^fiJt-*-5^^s/7 p X{is -LIB* >^ t UX 
^■t"* * 7tt#W«lcg<5^T±ia3EJfeiJR*££ric'*- ; 5 - i: 



WO 00/68886 



PCT/JP00/03039 



1/23 




WO 00/68886 



PCT/JP00/03039 




FIG.2 



WO 00/68886 



PCT/JPOO/03039 



3/23 



IS 

m 





Jflrml 



















M 
-< 



eg 



mm 



■fl- 



3 



CO 

d 



-f5 





Si 






m 












1 




i 





WO 00/68886 



PCT/JPOO/03039 



4/23 



1 


* 






























r 



S7 



S2 



S3 



S4 



S5 



FIG.4 



WO 00/68886 



PCT/JPOO/03039 



5/23 



J 1 



o 


o 


o 


o 






o 


o 


o 


o 


o 




o 


o 


o 


o 


o 




o 


o 


o 


o 


o 





FIG.5 



WO 00/68886 



PCT/JP00/03039 



6/23 



£1 
I* 

n 

A 



m 
m 

m 



CO 




Hi 




m 










4- 









. BIS 



8$ 




CO 

d 



I 



WO 00/68886 



PCT/JPOO/03039 



7/23 



c 



< 


1 




1 




WJ £ »f H> wtK-Y-J^M t i* * 


1 


r 















V 



S21 



S23 



/ 



S24 



^ »; ? - y ^ 



FIG.7 



WO 00/68886 



PCT/JPOO/03039 



8/23 




FIG.8 




FIG.9 



WO 00/68886 



PCT/JP00/03039 



9/23 




WO 00/68886 



PCT/JP00/03039 



10/23 



ED 



1 




p=0*7t(iq=0±O, 






r 








Uq+U.q , Vp+V.p , U p -U.p 


, Vq-V. q , U q -U-q , V p -V. p 




r 


W z fcVy£#^U Wy«hV Z ^5>iiL 

pgfciiq-eaijflc 




r 



1/ 



1/ 



S4r 



S42 



S43 



/ 



S44 



(JED 



FIG.11 



WO 00/68886 



PCT/JP00/03039 



11/23 




WO 00/68886 



PCT/JP00/03039 



12/23 




WO 00/68886 



PCT/JPOO/03039 



13/23 




34 



WO 00/68886 



PCT/JP00/03039 



14/23 



I 



roll*, pitch', yaw' £ A f] U V 

I 



x»,y'\ (z"-g)*«fll 

i 



r 



I 

FIG.15 



S61 
S62 

S63 



I 



S77 



S72 



FSG.1 



WO 00/68886 



PCT/JPOO/03039 



15/23 




(7 U- A|H]"CkiH) 



(un, vn) 
(Ulk, Vlk) 




("ml, Vml) 
(Umk, V m k) 



KM 
nl, n2..n6f|SI) 



Vxll 

Vyll 
Vzll 

Wxii 

WyH 

w z il 



Vxlni 

Vyln2 

w x in4 
Wyi„ r , 

w z i n6 



x'i 



y'i - 

Z'l - 
pitch 1 h 



yaw'i- 



Vxml 

Vyml 

Vzml 
Wxml 

Wyml 

Wzml 



v xmni ■ 
v ymn2 - 
v zmn3 - 
w xmnl - 
w ymns ■ 
Wzmnfi - 



X in 

y'm 

z 'm 
roll'm 
pitch' m 
yaw' m 



(-7 AraJT' 



x"i 

y"i 

z"i 
roll'i 
pitch 1 1 
yaw'i 



x in 
y m 
* m 



pitch» m 
yaw' m 



FIG.17 



WO 00/68886 



PCT/JP00/03039 



16/23 



Y— • 

S| 



m 

■R 



is 
m 

4- 



1\ 

! 

IK 



Si 



IK* 8 * 



its 85 



s 



«M| 



00 

d 



WO 00/68886 



PCT/JPOO/03039 



17/23 



c 



3 



V 



S81 



S82 



S83 



/ 



S86 



S84 



S85 




FIG. 19 



WO 00/68886 



PCT/JP00/03039 



18/23 




WO 00/68886 



PCT/JP00/03039 



19/23 




WO 00/68886 



PCT/JP 00/03039 



20/23 



Q xs^mz h wmr - * she * ? - h ) 



1 




mWMl&'Apitchr, roll r , x r , y r , z r £fH H 






fV:?^!l»W!rtc»pitch Si roll Sl yaw 8 £3l'# 













V 



V 



S111 



S112 



S113 



FIG.22 



WO 00/68886 PCT/JP00/03039 



21/23 





FIG.24 



WO 00/68886 



PCT/JPOO/03039 



23/23 



212 



CPU 



J_ 



213 



270 



-21 1 



Jl 



214 



4 V ? -7 x-* 



215 



IW13 



216 



FIG.25 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/JP00/03039 



A. CLASSIFICATION OF SUBJECT MATTER 

Int. CI 7 G06T 7/20, G09B 9/00, H04N 7/18 



A ccording to International Patent Classification (IPC) or to both national classification and IPC 

B. FIELDS SEARCHED — 

Minimum documentation searched (classification system followed by classification symbols) 
Int. CI 7 G06T 7/20, G09B 9/00-9/56, H04N 7/18, 
H04N 5/232, G03B 5/00, A63F 13/08, 

A63G 31/00- 31/16 

Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 
Jitsuyo Shinan Koho 1926-1996 Toroku Jitsuyo Shinan Koho 1994-2000 

Kokai Jitsuyo Shinan Koho 1971-2000 Jitsuyo Shinan Toroku Koho 1996-2000 

Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
JICST FILE(JOIS) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


A 


US, 5701522, A (Nikon Corp.), 
23 December, 1997 (23.12.97) 
6c JP, 7-20521, A 


1-63 


A 


US, 5107293, A (Canon K.K.), 

21 April, 1992 (21.04.92) 

& EP, 358196, Al & JP, 2-75284, A 


1-63 


A 


JP, 10-150595, A (Sony Corporation) , 
02 June, 1998 (02.06.98), 
Fig. 1 

(Family: none) 


1-63 


A 


JP, 4-58978, A (Mitsubishi Heavy Industries, Ltd.), 
25 February, 1992 (25.02.92) 
(Family: none) 


1-63 


A 


US, 5364270, A (Pioneer Electronic Corp.), 

15 November, 1994 (15.11.94) 

& EP, 525961, A2 & JP, 5-3968, A 


2-5, 23-26, 
44-47 



^ Further documents are listed in the continuation of Box C. Q See patent family annex. 



• Special categories of cited documents; "T later document published after the mtemattonal filing date or 
"A" document defining the general state of the art which is not priority date and not in conflict with the application but cited to 

considered to be of particular relevance understand the principle or theory underlying the '"venhon 
"E" earlier document but published on or after the international filing "X" document of particular relevance; the ctaimed invention cannot be 

date considered novel or cannot be considered to involve an inventive 
"L" document which may throw doubts on priority claim(s) or which is step when the document is taken alone 

cited to establish the publication date of another citation or other "V document of particular relevance; the claimed invention cannot be 

special reason (as specified) considered to involve an inventive step when the document is 
"O" document referring to an oral disclosure, use, exhibition or other combined with one or more other such documents such 

mews combination being obvious to a person skilled in the art 
"P" document published prior to the international filing date but later document member of the same patent family 


Date of the actual completion of the international search 
15 June, 2000 (15.06.00) 


Date of mailing of the international search report 
27 June, 2000 (27.06.00) 


Name and mailing address of the ISA/ 

Japanese Patent Office 

Facsimile No. 


Authorized officer 
Telephone No, 



Form PCT/ISA/210 (second sheet) (July 1992) 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/JP00/03039 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



PA 



JP, 5-265372, A ( Ishikawa j ima-Harima Heavy Industries 
Co . , Ltd . ) , 

15 October, 1993 (15.10.93) 
(Family: none) 

JP, 11-153949, A (Sony Corporation) , 
08 June, 1999 (08.06.99), 
Figs. 1, 2 
(Family: none) 



■5, 23-26, 
44-47 



1-63 



Form PCT/ISA/210 (continuation of second sheet) (July 1992) 



rn^mm^ pct/j p o o/o 3039 



a. 3km<om'rz&9Ko&m mm¥m&m (ipo ) 

Int. CI 7 G06T 7/20, G09B 9/00, H04N 7/18 



■st^o vEm»mm < i po > 

Int. C 1 7 G06T 7/20, G09B 9/0 0-9/5 6, H04N 7/18, 
H04N 5/2 3 2, G03B 5/00, A63F 13/08, 
A6 3G 3 1/0 0-3 1/1 6 



B*B%Ai9r&2t4R 1 9 2 6-1 9 96^ 

P^a^DRXffiVrlR&ff 1 9 7 1-2000^ 

0 *iaaftii^9r3e^« 1994-2000^ 

B*g2&g»r£aft£t« 1996-200 0¥ 



a^ac-c^u/c©^-^-<-^ (t*—*^— uwiiis) 

J I CST77^ ( J O I S) 



#^rf y-* 






A 


US, 5701522, A (Nikon Corp.) 23. 1 2M. 199 
7 (23. 12. 9 7) & JP, 7-20521, A 


1-6 3 


A 


US, 5107293, A (Canon K. K. ) 2 1. 04^. 19 9 2 
(2 1. 04. 9 2) &EP, 3 5 8 1 9 6, Al&JP, 2-7 
5 2 8 4, A 


1-63 


A 


JP, 10-150595, A (y=— «s5£tfc) 0 2. 0 6M. 
1998 (02. 06. 98) , Ml 


1-63 



(x] cm<Dm%tzhxmmmzfrx\^Zo 



0 ^ u < iiteco^ij <ea a twsrt- £ it ^ k 5 1 m -f £ 



r&j B-^fyh77^ y — XBfc 



15. 0 6. 0 0 




B#BI4WW? (I S A/J P) 
f?<E#^ 100-8915 
XK8fftHKW«BHTl 4#3^ 


mfg#^ 03-3581-1101 ^ 


5H 


9 18 1 


3 5 3 1 



SSPCT/ISA/2 10 <W2^-^) (1 9 9 8¥7^) 



SRItilSS-f- PCT/JPOO/03 0 3 9 



PA 



JP, 4-5897 8, A (£IHitt^tt) 2 5. 0 2fl. 1-6 3 

1992 (25. 02. 92) (7r5!J-4L) 

US, 5364270, A (Pioneer Electronic Corp. ) 1 5. 1 2-5, 23-26, 

lfi. 1994 (15. 1 1. 94) &EP, 525961, A2 44-47 
&JP, 5-396 8, A 

JP, 5-265372, A (^N A»*SlS6ttsS#tfc) 1 5. 2-5, 23-26, 

10J3. 1993 (15. 10. 93) (77^- fcL) 44-47 

JP, 11-153949, A (y=-ttt*^tt) 08. 06fl. 1-63 
1999 (08. 06. 99) , Hi, EI2 (7r5U— fcD 



ffiSPCT/ 



ISA/210 (IB 2^— VtoWlt) (1 99 8^71) 



